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Applied performance tests are instruments designed to 
measure performance in an actual or simulated setting. The 
identifying difference between applied performance and other tests is 
the degree to which the instrument approximates the reality of the 
situation in which the task must be performed. A Clearinghouse for 
Applied Performance Testing (CAPT) was proposed and undertaken in 
197^ by a consortium of four states — Hawaii, Oregon, Pennsylvania and 
Washington — in cooperation with the Noirbhwest Begional Educational 
Laboratory. Initially, CAPT emphasized the collection and 
dissemination of materials concerned with subject matter areas 
included in a traditional public school setting at grade levels K-12, 
but since the bulk of the research had been undertaken in business, 
the military, vocational/occupational training, professional 
education and adult education, collective efforts have been expanded 
to facilitate finding materials adaptable for public school use. The 
procedures used in collecting information, and also other sources for 
materials on applied performance testing, are discussed. (BH) 
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Thomas P. Sachse, Clearinghouse for Applied Performance Testlr-, 
Northwest Regional Educational Laboratory 

and 

James R, Sanders, The Evaluation Center, 
Western Michigan University 

INTRODUCTIOTI 

I would like to preface my remarks this morning with a brief 
discussion of the measurement technique we refer to as applied performance 
testing, and also to the Clearinghouse for Applied Performance Testing, 
commonly called CAPT. The main focus of my presentation will be on the 
procedures we have used in obtaining applied performance tests and 
testing materials, as well as the results of the first year of our efforts. 
The intent of this discussion is to highlight currently available 
materials and major centers of activity in the field of applied perform- 
ance testing, to provide updated information on the current status of the 
field, and to outline some fuffcure research and development directions for 
the area of applied performance testing. 

Definition of Applied Perfoi^n^ace Testing 

Applied Performance Tests are instruments designed to measure per- 
formance in an actual or simu-lated setting. In education, performance 
tests focus oi. the measurement of performance on tasks significant to a 
student^s Ufe outside th« sclioul or to adult life. In vocational and 
military training program?* > applied performance tests measure the skills 
or competencies a traiviee must acquire for effective job performance. 

Applied performanciS tests in education are applied in the sense 
that the instruments are designed to assess whether examinees can per- 
form tasks requiring the application of classroom learning. An applied 
performance test measures the end point, or terminal objective, in 
instruction. For example, high school mathematics students who are 
taught con^jutations involving percentages may be given a test which 
covers the material in much the same way it was taught. On the other 
hand, an applied performance test covering percentage could be used to 
assess a student^s ability in computing interest on a loan-application of 
a skill in a practical situation. Renewed interest In applied perform- 
ance testing stems from the desire of many educators (and lay persons) 
to direct classroom measurement toward the practical outcomes of 
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classroom learning. Some suggest that applied performance assessment 
could direct curriculum development to close the gaps between classroom 
learning and survival skills required for quality life In a complex 
society. 

In training settings » the distance between classroom instruction 
and on-the-job task requirements is greatly reduced, if not eliminated by 
the use of applied performance tests. Instnments developed by the Human 
Resources Research Organization (HumRRO) are designed to measure pre- 
spedfied objectives of a training program, yet are independent of 
instructional strategies employed in training. This procedure ensures 
measurements of proposed training outcomes, while reducing the possibility 
of teaching for the test. The degree of outcome specification is one 
main difference berveen training and education (training situations have 
specific outcomes that direct the content of lnstru|^tion and measurement). 

The identifying differ^ce between applied performance and other 
types of tests is the degree to which the Instrument approximates the 
reality of the situation in i^ich the tasl' must be performed. Applied 
performance tects are designed to Incorporate a high degree of realism 
into the test situation. (Realism, fidelity and authenticity are used 
interchangeably in describing the degree to which these tests mimic real 
life situations that require this task performance.). Because authen- 
ticity to real life encounters is relative, it is sometimes difficult— 
perhaps impossible^to clearly distinguish between those tests that are 
applied performance and those that are not. There is therefore a gray 
area in which categorization of applied performance tests becoihes very 
difficult. 

Item stimulus and response can act as £ocal points for applied 
performance test designation and it is possible to separate most instru- 
ments the basis of authentic reproduction of real life situations. 
The stimulus and response can both have either high or low fidelity. If 
either or both have high authenticity, the instrument may be labeled an 
applied performance test. Figure 1 depicts the categories of dlnstrument 
that fall into this definition of spiled performance testing. 

An example of high stimulus authenticity /low response authenticity 
would be an elaborate simulation (jet simulation trainer) that requires 
a multiple choice response to the stimulus situation. An example of a 
high stimulus authenticity/high response authenticity would be a real 
life situation (the ability to plan and cook a nutritionally con^lete 
dinner) that calls for the correct execution of the appropriate response 
(cooking the meal). An example of a low stimulus authenticity /high 
response authenticity would be a media simulation (police training film) 
that calls for real life skills (trainee makes and carries out a 
shoot/no shoot decision, where accuracy is assessed in the former case). 
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Figure 1. Definition of Applied Performance Tests 

The Judging of high or low authenticity is subjective, but this 
matrix offers an Interesting way of viewing the salient points of 
applied performance testing. Both descriptors » applied and performance, 
imply the difference between this testing technique and others. The 
proximity to realism in the testing situation is the distinguishing 
feature of applied performance testing. 

CAPT Description 

The Clearinghouse for Applied Performance Testing was cooperatively 
conceived, proposed and undertaken by a consortium of four states-Hawaii, 
Oregon, Pennsylvania and Washington. These member states have w< ked 
together with the Northwest Regional Educational Laboratory, to establish 
a mechanism for rapid access to applied performance testing materials, 
to disseminate Infoxmation about such materials and to begin filling gaps 
In the availability and use of applied perfortaance testing materials and 
procedures. 

The initial eizq>hasis in the collection and dissemination of 
applied performance testing materials was Initially directed toward 
subject matter areas included In traditional public school setting at 
grade levels K-12. However, the results of early CAPT collection efforts 
clearly Indicated that the bulk of the work in the field of applied 
performance testing had occurred beyond the scope of public school subject 
matter areas and grade levels. Extensive work had been undertaken in 
business, the military, vocational/occupational training and non-public 
school educational fields such as professional education (health fields, 
teacher«t raining, etc.) and adult education. Because of these findings 
collection efforts have been expanded to facilitate finding materials 
adaptable for public school use. 

Allow me to digress for a moment to discuss the procedures 
Involved in acquiring materials now available from CAPT. I will then 
!retum to a discussion of the results of collection activities over the 
past year. 





X 


X 


X 



X ■ Applied Performance 
Task 



4 

494 



PROCEDURES 



July-September 1974 

The CAPT Policy Board, consisting of one representative from each 
of the four iQeid)er states , adopted a general policy directing collection 
efforts to be carried out by the CAPT staff. This policy dictated that 
collection activities would be launched through a variety of strategies* 
Overlap In collection endeavors would Indicate full coverage of the field 
while new discoveries would indicate that different search methods could 
produce additional applied performance materials* 

^ It Is Important to note that many collection activities were under- 
taken for reasons other than the collection of applied performance testing 
materials* For example, the first collection strategy was conducted to 
publicly announce the establishment of CAPT and to solicit information 
about persons and projects in the field* A publicity release was sent to 
national education journals and regional and state informational publi- 
cations* Among those journals used to solicit information were: 

Education Dally Journal of Educational Research 

Educational Researcher Behavior Today 

Educational Leadership Educational Testing Service Recaps 

Measurement News Interstate Project Reporter 

Phi Delta K&ppan The Oregon Pipelfixe 

APA Monitor Educational Technology 

During the initial collection phase of the CAPT project, CAPT 
staff searched literature for tests or informational papers on applied 
performance testing* Because the field of applied performance testing 
was rather young (at least in terms of renewed interest in education), 
research efforts focused mainly 7n publications dUd projects from the 
last five years* Military source's of information, however, required more 
extensive research, since performance testing had been employed by the 
Military since World War II* 

Searches of coiq>uter information bases were conducted to reveal 
additional sources of information* Information bases searched included: 

Educaticmal Resources Information Center (ERIC) 
Research and Information Services for Education (RISE) 
Vocational Education Information Network (VEIN) 
National Technical Information Service (NTIS) 
Psychological /iistracts 

Results of the conq>uter searches varied widely-even within the same 
system-Klep ending on the search strategy and descriptions used* This 
variability stemmed from the fact that descriptors used within systems did 
not correspond to current notions of performance* This proved a complex 
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problem; not only did descriptors fall to match our definitions (thereby 
making access difficult) , but descriptors assigned during entry of the 
documents into the system were couched in a dated vocabulary. 

October-December 1974 

As X ;,PT staff conducted field surveys and literature searches , 
Brlgham Young University (BYU) undertook a search for additional sources 
of information about work in the field. The BYU staff completed a liter- 
ature survey as well as a field survey of applied performance testing 
activity. The literature survey netter' 350 annotated references. Many of 
these references duplicated present CAi . materials; however, there were 
enough new references to convince CAPT staff that the external search 
activity had indeed been beneficial to the project. 

The field tiurvey employed a questionnaire sent to 600 Individuals 
throughout the count i-y. In this surw special emphasis was placed on 
determining the need for and aval lab ill , of instructional materials 
for applied performance assessment. Unfortunately, the return rate of 
this questionnaire was quite low-perhaps because the questionnaire was 
sent just prior to Christmas, 1974. A follow-up study retrieved 
additional data. 

By the winter of 1974, many projects had been identified in the 
field, and the Policy Board noted approximately 30 as major centers of 
activity. In an effort to collect current information about new develop- 
ments In the field, the CAPT Policy Board and staff visited these projects. 
CAPT staff developed an interview format for collecting required data. 
Because of variations among these centers, the interview schedule was 
modified to fit each situation. CAPT staff were primarily interested in 
obtaining data on (a) an overview of the project, (b) use of applied 
performance testing, (c) available measures or procedural papers on 
applied performance testing, and (d) knowledge about other projects using 
applied perfomance testing. These site visits proved quite beneficial. 
Although some projects were not as deeply Involved In testing as 
originally believed, most had materials and references that were of great 
utility to CAPT and CAPT users. The following centers of activity were 
visited by CAPT representatives. 

Visitation Sites in Washington, D.Co 

o Superintendent of Documents 
Government Printing Office 

o Federal Aviation Administration 

o Human Resources Research Organization (HumRRO) 
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o Office of Research 

National Institute of EducatlOi> 

U*S* Department of Health » Education and Welfare 

o Test Services Center 

Personnel Research & Development Center 
U. S. CLvll Service Comnlsslon 

o President's Council cn Physical Fitness 

o U* S* Department of the Treasury 

Internal Revenue Service (Training Dlvlsloa) 
Consolidated Federal Law Enforcement Training Center 

Visitation Sites In Chicago, Illinois 

o Chicago Urban Skills Institute 

o Center for Educational Development at the 
University of Illinois Medical Center 

Visitation Sites at the Educational Testing Service (ETS) In 
Princeton 9 New Jersey 

o Cooperative Assessment of Experiential Learning (CAEL) 

o Netlonal Occupational Competency Testing Institute 

o ERIC Clearinghouse on Tests, Measurement and Evalixatlon 

o ETS Test Collection 

Visitation Sites at Other Locations 

o Southern Association of Schools and Colleges at Atlanta » Georgia 

o U* S. Amy Combat Arms Tralnlitg Board at Fort Bennlng, Georgia 

o Measurement Information Exchan^^e (Project MIX) at Boulder, 
Colorado 

o Cooperative Accountability Project, Colorado State Department 
of Education at Denver, Colorado 

o National Assessment of Educational Progress (NAB?) at Denver, 
Colorado 

o United Airlines Flight Trainlits Center at Denver, Colorado 
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o Adult Performance Level Study , The University of Texas at 
Austin, Texas 

o Research and Development Center for Vocational Education at 
Columbus, Ohio 

January-March t975 

Ongoing activities, such as solicitations and literature searches, 
continued to expand CAPT holdings. PublicatiGn of the CAPT Newsletter 
continued on a bi-monthly basis to provide information on CAPT activities 
and on the statwi of the field. Th^ January issue of the CAPT Newsletter 
contained a list of ••References Related to Applied Performance Assessment 
subdivided into three sections according to accessibility of the materials 
One section listed documents available from ERIC Microfiche collections. 
Another provided references to matetials collected by and available from 
CAPT» An order form was attached for users' convenience in obtaining 
materials from CAPT. This list was generated before al3 collection 
activitien had ceased, in order that applied performance tests and testing 
materials might be disseminated to educators before the school year had 
ended. Teachers could then begin using applied performance tests in 
planning their assessment activities. 

On March 30, 1975, a National Conference on the Future of Applied 
Performance Testing was held in Washington, D. C. , in conjunction with the 
AERA/NCME annual meetings. This conference, co-sponsored by NCME and CAPT 
served to further educate interested persons in the use of this valuable 
assessment technique. Proceedings of this conference have been made 
available to those unable to participate. Conference participants were 
provided an opportunity to add input during small group discussion 
sessions, and to gain, through working sessions, a sense of direction for 
future research in the field. The National Conference, originally 
intended as a dissemination activity, was quite useful as an information 
collection device because applicants and participants at the conference 
were generous in providing information about projects and products not 
previously encountered by CAPT. 

July-September 1975 

An updated version of the document ••References Related to Applied 
Performmce Testing" was enclosed with the July issue of the CAPT News- 
letter. The updated reference list was divided by sections indicating 
Lhe availability of the materials (similar to the January version) and 
materials available from CAPT were categorized by subject matter for 
otxieriiig ease. This document included many materials collected from 
January to July and provided detailed ordering information. 

The September 1975 issue of the CAPT Newsletter contains a 64-page 
Annotated Bibliography on Applied Performance Testing* This document 
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contains summaries of all docuroents available from CAPT, arranged by 
subject matter categories as In the Related References document. The 
latter two documents ^represent the culmination of CAPT collection efforts 
In the field of applied performance testing to the present. 

RESULTS 

Content Area Emphases 

The myriad of collection activities described above portray the 
state of the art In applied performance testing. As one might expect ^ 
applied performance testing Is well developed In subject matter areas 
where the product of Instruction requires the same performance. Occu- 
pational fields such as ^^atpentry^ mechanics , clerical education and 
masonry rely en both performance tests and complementary paper and pencil 
tests ^.o certify occupational competency. Professional occupations-^ 
especi^jlly the medical arts and teaching-have been very active In using 
performance training and testing. The Military and private Industry have 
also used performance testing extensively. 

Simulation Is a well-developed facet of applied performance testing. 
Business and the medical arts are proficient users of simulation and 
gaming techniques. Simulation has some distinct advantages over actual 
performance testing. Including reduced cost. Increased sampling of 
behavior, reduced consequences due to error, and the possibility for 
variation while maintaining standardization. 

Traditional public school content areas often lack applied perform"* 
ance testing devices. Increased interest and development In basic skills 
assessment, however, will soon change this; a growing concern to assess 
school subject matter In terms of life skills will require additional 
measures of an £q;>pl:led performance nature. But even now the Clearinghouse 
for Applied Performance Testing Is capable of providing technical instru- 
ments for measurement of public school content areas* By assisting In 
the development and dissemination of new measures, CAPT Is not only 
promoting the use of applied performance testing, but also helping to 
meet the growing need for validated applied performance Instruments. 

In searching for applied performance tests in public school content 
areas, substantial variance was found in the number of Instruments 
available by content area. Applied performance tests were found for 
reading and mathematics at the Junior high and high school levels. 
Although test items in reading and math were encountered for the elemen- 
tary levels, most were traditional paper and pencil items rather than 
problem-solving or application exercises measuring mathematical compe- 
tencies. Similar findings were made in psychomotor skills assessment. 
Applied performance tests were available for junior high and high school, 
but little was found for K-6 grade levels. 

A number of subject matter areas were void of applied performance 
tests 1 Social sciences (including history, civics, psychology, 
philosophy and economics), physical sciences (including geology, geography, 
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biology and physics) and foreign languages are content areas for which no 
tests of an applied performance nature wera found by CAPT search 
activities. Certainly the latter two content areas , physical sciences 
and foreign languages » place heavy emphasis on performance. Therefore » 
applied performance test development should be expected In these content 
areas. The Arts (Including drama, literature , and art and music forms) 
Is another area where applied perfomiance test development has not met Its 
potential. 

The fact that applied performance tests are not available in these 
public school content areas does not Imply that performance ineasurement 
of student progress does not occur. Rather, performance measurement 
that does occur usually takes place In an Informal non-standardized 
testing situation In which neither the examinee nor examiner are certain 
of the criteria (or the weightings of those criteria) upon which the 
performance is evaluated. One of the goals of the CAPT Project is to 
reduce the number of informal performance tests by highlighting positive 
aspects of standardized applied performance tests and by providing 
evaluative criteria upon which applied performance tests may be Judged. 

CAPT: A Resource 

The CAPT Newsletter has been the vehicle by which CAPT has 
endeavored to extol the virtues of standardization in applied performance 
testing. Dr. Janet Sumlda, Hawaii representative to the CAPT Project, 
has collected a list of evaluative criteria that can be used to evaluate 
applied performance tests. These criteria are available upon request 
from the Clearinghouse and I have brought you copies for those of you 
interested in reviewing or revising applied performance instruments. 

The CAPT Project is continuing to be responsive to the needs of 
the CAPT consumer audience. During the second year of CAPT operations, 
evaluative criteria will be formalized into an evaluation model for 
Judging an applied performance test. Producing means of evaluating 
applied performance tests is not the only effort by CAPT to advance the 
state of the art in applieyd performance testing. In addition to 
dissemination activities such as the CAPT Newsletter's reference lists 
and the Annotated Bibliography, CAPT is developing materials viewed as 
necessary to the expansion of the field. 

One such effort is the development of instructional materials on 
applied performance testing. These instructional units are being pro- 
duced to introduce teachers and administrators to the concepts and 
applications of applied performance testing for student evaluation in the 
classroom. An extension of the work on instructional materials will 
develop exportable training packages that will provide more information 
on the uses of applied performance testing. These packages will be pilot 
tested in the four member states and will be generally available after 
revision work has been completed. . . 

Another CAPT product will be the Handbook on Applied Performance 
Testing. This handbook will include a compilation of monographs written 
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by persons working In the field of applied performance testing. The 
content of this document will be mo\ce technical than the training package, 
yet suitable for Independent study or as a resourcf^ text. 

Clearinghouse representatives actively participate in conferences 
dealing with applied performance testing. Visitations to major centers of 
activity in the tXeld are providing CAPT with new information and are 
t^cfablishing a mechanism for the continual sharli;,^ of new developments. 

Although resources for undertaking the development of new applied 
performance tests are scarce , CAPT is committed to filling gaps where no 
instruments are currently available. To the extent possible , CAPT will 
begin to develop applied perforiiEiance tests in the aforementioned public 
school subject matter areas. 

CAPT staff has continued to work with agencies such as the 1J. S« 
Office of Education (USOE) and Defense Activities for Non-Traditional 
Educational Support (DANTES) to furtlier the state of the art in perform- 
ance testing. Tests of functional adult literacy have been collected 
and evaluated for USOE. These test evaluations will be used for decision 
making in RJ.ght to Ilead acd other literacy programs. Tests of occu- 
pational and vocational competence have been identified and described 
together with descriptions of testing programs available to achieve 
competence in such areas , in a report to DANTES. These two adjunct projects 
to CAPT are an indication of the commitment the Clearinghouse has made to 
furthering the practice of applied performance testing. 

Other Center^) of Activity 

Besides CAPT, there are a number of agencies working to expand 
current knowledge in the field of applied performance testing. The Human 
Resources Research Organization (HumRRO) has been designing performance 
tests-malnly for the mllitary-for 22 years. Through this involvement in 
performance testing, HumRRO has produced valuable procedural papers on 
developing performance tests and on conducting task analyses. The Human 
Resources Research Organization has seven divisions located throughout 
the country. Personnel including: Saul Lavisky at HumRRO* s main office 
in Alexandria, Virginia; Thomas Sticht at the Monterey, California 
Division; William Osborne at the Fort Knox, Kentucky Division, have been 
involved with and supportive of the CAPT Project. 

The Center for Educational Development (CED) performs various 
support functions for the University of Illinois Hedical Center, 
including designing assessment procedures for the allied health pro- 
fessions. In this area of sispport, CED is currently concerned with: 

1. Working with School of Medicine faculty to design tests that 
will assess the accuracy of clinical judgments, including 
written simulations, mannequin simulations and checklists for 
the performance of specific tasks. 
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2. Working with specialty boards to design tests to certify 
competence in medical specialties • 

3. Research and development efforts in the area of self -assessment 
techniques for physicians in practice. 

Drsr. Christine McGuire ard HuJda Grcbman have given valuable 
assistance to the CAPT Project, especially in planning the National 
Conference on the Future of Applied Performance testing. They have also 
added to the growth of the field in simulation measuremesit through instru- 
ments produced and papers published at the Center. 

The Cooperative Assessment of Experiential Learning (CAEL) located 
at Educational Testing Service in Princeton, New Jersey conducts activit:les 
that fall into three major phases. The first phase involves research and 
development efforts to produce techniques or processes for assessing 
experiential learning. The second phase >concems the validation of 
products developed in the first phase. Various member institutions have 
volunteered to field test products of the development phase. The third 
phase is the dissemination and application of validated products. This 
phase will Include the training of individuals in the use of the developed 
and validated procedures. Tangible output to date includes three major 
publications: 

1. ••CAEL Resource Book" Includes references to persons/projects 
working in the field of experiential learning, and a bibliography 
of references on experiential learning. 

2. ••Current Practices in the Assessment of Experiential Learning," 
a working paper on assessment techniques currently in use in 
various institutions of higher education. ^ 

3. ••A Compendium of Assessment Techniques," another working paper. 
Dr. John R. Valley directs this project and has been the main 
CAPT contact. Information sharing with this organizatic^ has 
been most beneficial to the CAPT consumer audience. 

The National Occupational Competency '''.^stitute (NOCTI) also located 
at Educational Testing Service in Princeton :^ew Jersey was originally 
known as the National Occupational Competr :y Project. The project had 
three main objectives: 

1. To establish a consortium of states needing occupatio.^dl 
competency tests designed to certify teachers of that particular 
occupation. 

2. To determine the state-of-the-art In occupational competency 
testing-*it was found that only a paucity of tests existed and 
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in many cases state departments of education were duplicating 
other efforts In test development. 

3. To develop needed tests and associated testing materials. 

Since becoming an Institute, NOCTI has explored the feasibility of 
administering national occupational competency tests; 1200 examinations 
are now administered yearly to future teachers in each of 24 occupational 
areas. These exams are used for three main purposes: 

1. To obtain data for selection in teacher education programs. 

2. To provide proficiency credits by examination. 

3. To certify competency in an occupation. 

Dr. Adolf Panltz, Director of the original project as well as the 
present institute, has assisted CAPT through personal dialogue and 
directing CAPT representatives to other major centers of activity and 
documents in the field. 

The Combat Arms Training Board (CATS) in Fort Bennlng, Georgia 
is responsible for developing instructional systems and complementary 
materials (including performance tests) for all military occupation 
specialties. Within this framework, GATE is developing an Instructional 
Systems I>dvelopment (ISD) Model and several manuals (presently under 
developme^it) that will be used in training. In addition, CATB is 
developing many performance-based tests in connection with performance- 
based instruction programs. Although some of these materials are 
available at GATE, most are located at training sites. The goal of GATE 
is to provide in various^venf ually all<-Army occupations. 

The objectives of the Adult Performance Level (APL) Project located 
at the University of Texas at Austin, under the direction of Dr. Norvelle 
Northcutt, are to (1) develop a meaningful, accountable description of 
adult functional literacy for the United States, and (2) create techniques 
for assessing functional literacy which are useful in national and state 
policy plaxinlng. 

In three years of research, the APL Project has developed a 
taxonomy which conceptualizes adult functional literacy as the appli- 
cation of a set of skills (communication, computation, problem solving, 
and Interpersonal relations) to a set of '^general knowledge areas" 
which are particularly important to success in American society as 
operationally defined by income, education and occupation. The general 
knowledge areas are consumer economics, occupationally related knowledge, 
healthy connunity resources and government and law. 

Adult functional literacy is described in terms of "objectives" 
which relate to these skills and general knowledge areas. Adult functional 
literacy is seen by APL as mastery of these objectives to maximize the 
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likelihood of • •success* • in terms of being better educated, making more 
money 9 and holding better jobs. The more objectives an adult masters, 
the higher his/her level of literacy* 

The APL Project has developed an assessment technique involving, 
random samples of adults throughout the country who belong to one of 
several levels of literacy. These data, in combination with the APL 
operational definition of * •success, provide a well-defined estimate 
of the total nuniber of adults in the country who belong to each level of 
literacy* 

The Ohio State University Center for Vocational Education houses 
the Task Inventory Exchange (TIE) under the direction of Robert Taylor. 
The Ta^k Inventory Exchange conducts task inventories or analyses; pro- 
cedures that delineate all activities performed by workers on a 
particular job. Task analyses are of major utility to curriculum developers 
and performance test developers. These task analyses are used in 
identifying content for instruction or for measurement devices for applied 
performance tests. 

In addition to individual projects and agencies such as those 
listed above, many public school education units from classrooms to state 
departments of education are beginning work in the field of applied 
performance testing. Movements toward competency-based measurement in 
which applied performance testing is most useful are observed at state 
levels, particularly in New York, Oregon, and California. Many districts 
in these and other states are beginning to stress real life outcomes of 
classroom learning. These local efforts will turn to agencies mentioned 
above for technical assistance in planning and implementing applied 
performance assessment. Education journals are not seen presently as a 
source of current information on the theoretical and practical impli- 
cations of this measurement technique. 

Other Sources 

Although no single journal can be identified as a source of 
information on applied performance testing, occasionally articles appear 
on this measurement technique. The following are journals that print 
papers related to applied performance testing: 

Agricultural Education Magazine 
Child Development 

Educational and Psychological Measurement 
Educational Leadership 
Educational Technology 
Journal of Educational Measurement 
Journal of Experiential ISducation 
Journal of Industrial Teacher Education 
Journal of Teacher Education 
Mathematics Teacher 
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Perceptual and Motor Skills 
Psychological Reports 
Reading Research Quarterly 
School Review 
Teacher Educator 
Training 

Many additional sources of Information on applied performance 
testing have been mentioned earlier In the procedures section. Certainly, 
ERIC and slmllatr co^uter""based Information retrieval systems are valuable 
Information bas©i; for general Inquiries. (Access Is limited, however, by 
the Inadequacy of the descriptors used.) CAPT products, available upon 
request, are most directly relevant to the field of applied performance 
testing, as are documents available from major centers of activity 
mentioned above. Occasionally, chapters In measurement texts deal with 
performance measurement or product evaluation. These overviews are 
usually adequate as Introductory materials. 

DISCUSSION 

Interest In, and use of, applied performance testing as a measure- 
ment technique has expanded over the past few years. Increased emphasis 
In public school education on "real life" application of classroom 
learning has been the main factor In the Increased aware^iess of applied 
performance testing. This eiiq>hasls becomes clear as districts and states 
move toward competency-based Instruction and measurement* 

A number of states and districts are currently moving to 
competency-based measurement for promotion or graduation requirements. 
Oregon lav now mandates the assessment of minimum competencies In a 
variety of subject matter areas as a prerequisite to high school graduation* 
The State of Washington has Initiated a program allowing a student ^^early 
exlt»» from high school after certification that he or she has satis- 
factorily demonstrated conq>etence In a number of required subject matter 
areas. Hacwall has Implemented a statewide assessment program that employs 
competency-based measurement devices. 

There are many reasons why school people are adopting competency- 
based educational programs as a substitute for (but oftentimes In addition 
to) the tr^iiltlonal methods of promotlon-that Is, completion of course- 
work, or school attendance. For example, the Increased emphasis on the 
specification of educational objectives In Instructional programs has 
encouraged adoption of competency-based programs. Behavioral or 
performance objectives Include a delineation of the specific knowledge or 
skill to be demonstrated, the manner In which the task will be undertaken 
by the student and the precise level of performance which will be con- 
sidered satisfactory In completing the objective. Detailed specification 
of educational objectives allows Increased accuracy. In the measurement of 
educational goals. 
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The Interest in using conq>etency"based Instruments greatly preceded 
theoretical refinements and development of these measures in education. 
Development begj!>n at the classroom level, and gradually proceeded to the 
state level in education. The military and private industry (to a lesser 
degree) have prepared themselves via a slower evolutionary process. 

The rationale for the military and private Industry's interest, 
acceptance and use of applied performance testing relates another major 
reason for the educational community's growing interest and use of this 
technique. As had been stated earlier, applied performance testing 
measures performance of some task significant to life' outside the 
instructional setting. This technique requires performance in a simulated 
or actual setting. Therefore, those agencies whose instruction enables a 
student to perform an in^ortant life task view f^plied performance 
testing as a ibeasurement technique consistent with outcomes of instruction. 
The military and business comnunlties train personnel to perform a 
specific Job; and measurement is tied to the actual Job performance. 
Education, which has in the past been largely preparatory to generally 
defined life goals outside the school, is now committing itself to the 
acquisition of life skills. Because of the new commitment to teach 
skills which are viewed as valuable for adults in a complex society, 
education has found applied performance testing a valid measurement 
technique. 

Adoption of this technique within education has, however, varied 
substantially. Applied performance testing is seen as valuable in those 
content areas in which the desired product of Instruction is performance. 
Examples of content areas In which applied performance testing is relevant 
Include: vocational/ocr rional education, physical education, the arts, 
and foreign languages. evident that even within the content areas 

for which applied performa^^ce testing is relevant, the relative emphasis 
placed on development of standardized measures has differed widely. 

Two additional factors relate to the development cf formalized 
applied performance tests. One factor is the degree to which a move 
toward standardization is seen as important or feasible. In vocational 
and physical education, the emphasis on standardization has resulted in 
many formalized applied performance tests. In the arts and foreign 
language education, less emphasis has been placed on formalizing applied 
performance tests. This is most likely due to the feasibility of 
standardizing aesthetic performances In the arts, and to interest in or 
need for such tests in the foreign languages. At the present time it is 
difficult to Justify the formalization of applied performance tests in 
all content areas. 

Another factor yet to be explored regarding development of applied 
performance tests is grade level. Because of the preparatory nature of 
elementary education, less subject matter within that level is relevant 
to applied performance testing. Surely reading and math skills are not 
yet developed to the point where application of life skills is necessary 
for student evaluation. The scope of most subject matter areas is 
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reduced tc lower levels of Bloom's and Krathwohl*s taxonomies. Therefore, 
applied performance testing is less applicable in lower grade levels 
where pexfcrmances are not part of the leamin^j outcomes. However, this is 
not to s&y applied performance testing is never applicable at the 
elementary level, lying one's shoe or buttoning an overcoat are examples 
of tasks best measured in an applied performance setting. 

The rationale behind development of applied performance testing is 
multi-faceted Indeed. We have examined three main factors that contribute 
to the use of applied performance tests: (1) relevance of the technique 
to measure expected outcomes in the content area, (2) desire for or 
feasibility of standardization of informal performance measures currently 
in use, and (3) grade level or taxonomic complexity of acquired skills. 

Another very Important consideration is the treatment of applied 
performance testing as but one small part of the entire testing spectn?5i 
available to those involved in instruction and evaluation. It is not a 
panacea for testing problems in training and education, it is not a 
replacement for the many highly developed technical tools we are now using; 
and it is certainly not a synonym for a new curriculum movement in our 
schools. It is a way to collect information about task performance that 
is useful in certain training and education settings and should be treated 
as simply that. 

Factors such as cost, administration and scoring time, the 
availability of applied performance tests and COTipatibility of applied 
performance testing with the present system for student evaluation must be 
considered in planning for the use of applied performance tests. Although 
these factors tend to limit the practicability of applied performance 
testing, taider certain conditions, they do not negate its utility • Current 
research and development should help to offset negative aspects of such 
factors. Group administered applied performance tests and synthetic 
performance tests and simulations can open the way for feasible applied 
performance testing without compromising the utility of this technique. As 
public support for this type of measurement grows, CAPT and many other 
agencies will expand the state-of-the-art in applied performance testing 
and thereby close the gap between the demand for and availability of 
applied performance tests. 
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